Complex Normal Distribution
   HOME

TheInfoList



OR:

In
probability theory Probability theory is the branch of mathematics concerned with probability. Although there are several different probability interpretations, probability theory treats the concept in a rigorous mathematical manner by expressing it through a set o ...
, the family of complex normal distributions, denoted \mathcal or \mathcal_, characterizes
complex random variable In probability theory and statistics, complex random variables are a generalization of real-valued random variables to complex numbers, i.e. the possible values a complex random variable may take are complex numbers. Complex random variables can alw ...
s whose real and imaginary parts are jointly
normal Normal(s) or The Normal(s) may refer to: Film and television * ''Normal'' (2003 film), starring Jessica Lange and Tom Wilkinson * ''Normal'' (2007 film), starring Carrie-Anne Moss, Kevin Zegers, Callum Keith Rennie, and Andrew Airlie * ''Norma ...
. The complex normal family has three parameters: ''location'' parameter ''μ'', ''covariance'' matrix \Gamma, and the ''relation'' matrix C. The standard complex normal is the univariate distribution with \mu = 0, \Gamma=1, and C=0. An important subclass of complex normal family is called the circularly-symmetric (central) complex normal and corresponds to the case of zero relation matrix and zero mean: \mu = 0 and C=0 . This case is used extensively in
signal processing Signal processing is an electrical engineering subfield that focuses on analyzing, modifying and synthesizing ''signals'', such as audio signal processing, sound, image processing, images, and scientific measurements. Signal processing techniq ...
, where it is sometimes referred to as just complex normal in the literature.


Definitions


Complex standard normal random variable

The standard complex normal random variable or standard complex Gaussian random variable is a complex random variable Z whose real and imaginary parts are independent normally distributed random variables with mean zero and variance 1/2. Formally, where Z \sim \mathcal(0,1) denotes that Z is a standard complex normal random variable.


Complex normal random variable

Suppose X and Y are real random variables such that (X,Y)^ is a 2-dimensional normal random vector. Then the complex random variable Z=X+iY is called complex normal random variable or complex Gaussian random variable.


Complex standard normal random vector

A n-dimensional complex random vector \mathbf=(Z_1,\ldots,Z_n)^ is a complex standard normal random vector or complex standard Gaussian random vector if its components are independent and all of them are standard complex normal random variables as defined above. That \mathbf is a standard complex normal random vector is denoted \mathbf \sim \mathcal(0,\boldsymbol_n).


Complex normal random vector

If \mathbf=(X_1,\ldots,X_n)^ and \mathbf=(Y_1,\ldots,Y_n)^ are random vectors in \mathbb^n such that mathbf,\mathbf/math> is a normal random vector with 2n components. Then we say that the
complex random vector In probability theory and statistics, a complex random vector is typically a tuple of complex-valued random variables, and generally is a random variable taking values in a vector space over the field of complex numbers. If Z_1,\ldots,Z_n are comp ...
: \mathbf = \mathbf + i \mathbf \, is a complex normal random vector or a complex Gaussian random vector.


Mean, covariance, and relation

The complex Gaussian distribution can be described with 3 parameters: : \mu = \operatorname mathbf \quad \Gamma = \operatorname \mathbf-\mu)(-\mu)^ \quad C = \operatorname \mathbf-\mu)(\mathbf-\mu)^ where \mathbf^ denotes
matrix transpose In linear algebra, the transpose of a matrix is an operator which flips a matrix over its diagonal; that is, it switches the row and column indices of the matrix by producing another matrix, often denoted by (among other notations). The tr ...
of \mathbf, and \mathbf^ denotes
conjugate transpose In mathematics, the conjugate transpose, also known as the Hermitian transpose, of an m \times n complex matrix \boldsymbol is an n \times m matrix obtained by transposing \boldsymbol and applying complex conjugate on each entry (the complex con ...
. Here the
location parameter In geography, location or place are used to denote a region (point, line, or area) on Earth's surface or elsewhere. The term ''location'' generally implies a higher degree of certainty than ''place'', the latter often indicating an entity with an ...
\mu is a n-dimensional complex vector; the
covariance matrix In probability theory and statistics, a covariance matrix (also known as auto-covariance matrix, dispersion matrix, variance matrix, or variance–covariance matrix) is a square matrix giving the covariance between each pair of elements of ...
\Gamma is
Hermitian {{Short description, none Numerous things are named after the French mathematician Charles Hermite (1822–1901): Hermite * Cubic Hermite spline, a type of third-degree spline * Gauss–Hermite quadrature, an extension of Gaussian quadrature m ...
and
non-negative definite In mathematics, a symmetric matrix M with real entries is positive-definite if the real number z^\textsfMz is positive for every nonzero real column vector z, where z^\textsf is the transpose of More generally, a Hermitian matrix (that is, a c ...
; and, the '' relation matrix'' or ''pseudo-covariance matrix'' C is
symmetric Symmetry (from grc, συμμετρία "agreement in dimensions, due proportion, arrangement") in everyday language refers to a sense of harmonious and beautiful proportion and balance. In mathematics, "symmetry" has a more precise definiti ...
. The complex normal random vector \mathbf can now be denoted as \mathbf\ \sim\ \mathcal(\mu,\ \Gamma,\ C). Moreover, matrices \Gamma and C are such that the matrix : P = \overline - ^\Gamma^C is also non-negative definite where \overline denotes the complex conjugate of \Gamma.


Relationships between covariance matrices

As for any complex random vector, the matrices \Gamma and C can be related to the covariance matrices of \mathbf = \Re(\mathbf) and \mathbf = \Im(\mathbf) via expressions : \begin & V_ \equiv \operatorname \mathbf-\mu_X)(\mathbf-\mu_X)^\mathrm T= \tfrac\operatorname Gamma + C \quad V_ \equiv \operatorname \mathbf-\mu_X)(\mathbf-\mu_Y)^\mathrm T= \tfrac\operatorname \Gamma + C \\ & V_ \equiv \operatorname \mathbf-\mu_Y)(\mathbf-\mu_X)^\mathrm T= \tfrac\operatorname Gamma + C \quad\, V_ \equiv \operatorname \mathbf-\mu_Y)(\mathbf-\mu_Y)^\mathrm T= \tfrac\operatorname Gamma - C \end and conversely : \begin & \Gamma = V_ + V_ + i(V_ - V_), \\ & C = V_ - V_ + i(V_ + V_). \end


Density function

The probability density function for complex normal distribution can be computed as : \begin f(z) &= \frac\, \exp\!\left\ \\ pt &= \tfrac\, e^, \end where R=C^ \Gamma^ and P=\overline-RC.


Characteristic function

The
characteristic function In mathematics, the term "characteristic function" can refer to any of several distinct concepts: * The indicator function of a subset, that is the function ::\mathbf_A\colon X \to \, :which for a given subset ''A'' of ''X'', has value 1 at points ...
of complex normal distribution is given by : \varphi(w) = \exp\!\big\, where the argument w is an ''n''-dimensional complex vector.


Properties

* If \mathbf is a complex normal ''n''-vector, \boldsymbol an ''m×n'' matrix, and b a constant ''m''-vector, then the linear transform \boldsymbol\mathbf+b will be distributed also complex-normally: : Z\ \sim\ \mathcal(\mu,\, \Gamma,\, C) \quad \Rightarrow \quad AZ+b\ \sim\ \mathcal(A\mu+b,\, A \Gamma A^,\, A C A^) * If \mathbf is a complex normal ''n''-vector, then : 2\Big (\mathbf-\mu)^ \overline(\mathbf-\mu) - \operatorname\big((\mathbf-\mu)^ R^ \overline(\mathbf-\mu)\big) \Big \sim\ \chi^2(2n) * Central limit theorem. If Z_1,\ldots,Z_T are independent and identically distributed complex random variables, then : \sqrt\Big( \tfrac\textstyle\sum_^T Z_t - \operatorname _tBig) \ \xrightarrow\ \mathcal(0,\,\Gamma,\,C), :where \Gamma = \operatorname Z^/math> and C = \operatorname Z^/math>. * The modulus of a complex normal random variable follows a
Hoyt distribution The Nakagami distribution or the Nakagami-''m'' distribution is a probability distribution related to the gamma distribution. The family of Nakagami distributions has two parameters: a shape parameter m\geq 1/2 and a second parameter controlling ...
.


Circularly-symmetric central case


Definition

A complex random vector \mathbf is called circularly symmetric if for every deterministic \varphi \in [-\pi,\pi) the distribution of e^\mathbf equals the distribution of \mathbf . Central normal complex random vectors that are circularly symmetric are of particular interest because they are fully specified by the covariance matrix \Gamma. The ''circularly-symmetric (central) complex normal distribution'' corresponds to the case of zero mean and zero relation matrix, i.e. \mu = 0 and C=0. ''bookchapter, Gallager.R''
/ref> This is usually denoted :\mathbf \sim \mathcal(0,\,\Gamma)


Distribution of real and imaginary parts

If \mathbf=\mathbf+i\mathbf is circularly-symmetric (central) complex normal, then the vector [\mathbf, \mathbf] is multivariate normal with covariance structure : \begin\mathbf \\ \mathbf\end \ \sim\ \mathcal\Big( \begin \operatorname\,\mu \\ \operatorname\,\mu \end,\ \tfrac\begin \operatorname\,\Gamma & -\operatorname\,\Gamma \\ \operatorname\,\Gamma & \operatorname\,\Gamma \end\Big) where \mu = \operatorname mathbf= 0 and \Gamma=\operatorname mathbf \mathbf^/math>.


Probability density function

For nonsingular covariance matrix \Gamma, its distribution can also be simplified as : f_(\mathbf) = \tfrac\, e^ . Therefore, if the non-zero mean \mu and covariance matrix \Gamma are unknown, a suitable log likelihood function for a single observation vector z would be : \ln(L(\mu,\Gamma)) = -\ln (\det(\Gamma)) -\overline' \Gamma^ (z - \mu) -n \ln(\pi). The standard complex normal (defined in )corresponds to the distribution of a scalar random variable with \mu = 0, C=0 and \Gamma=1. Thus, the standard complex normal distribution has density : f_Z(z) = \tfrac e^ = \tfrac e^.


Properties

The above expression demonstrates why the case C=0, \mu = 0 is called “circularly-symmetric”. The density function depends only on the magnitude of z but not on its
argument An argument is a statement or group of statements called premises intended to determine the degree of truth or acceptability of another statement called conclusion. Arguments can be studied from three main perspectives: the logical, the dialectic ...
. As such, the magnitude , z, of a standard complex normal random variable will have the
Rayleigh distribution In probability theory and statistics, the Rayleigh distribution is a continuous probability distribution for nonnegative-valued random variables. Up to rescaling, it coincides with the chi distribution with two degrees of freedom. The distribut ...
and the squared magnitude , z, ^2 will have the
exponential distribution In probability theory and statistics, the exponential distribution is the probability distribution of the time between events in a Poisson point process, i.e., a process in which events occur continuously and independently at a constant average ...
, whereas the argument will be distributed uniformly on \pi,\pi/math>. If \left\ are independent and identically distributed ''n''-dimensional circular complex normal random vectors with \mu = 0, then the random squared norm : Q = \sum_^k \mathbf_j^ \mathbf_j = \sum_^k \, \mathbf_j \, ^2 has the
generalized chi-squared distribution In probability theory and statistics, the generalized chi-squared distribution (or generalized chi-square distribution) is the distribution of a quadratic form of a multinormal variable (normal vector), or a linear combination of different no ...
and the random matrix : W = \sum_^k \mathbf_j \mathbf_j^ has the
complex Wishart distribution In statistics, the complex Wishart distribution is a complex version of the Wishart distribution. It is the distribution of n times the sample Hermitian covariance matrix of n zero-mean independent Gaussian random variables. It has support for p ...
with k degrees of freedom. This distribution can be described by density function : f(w) = \frac\ e^ where k \ge n, and w is a n \times n nonnegative-definite matrix.


See also

*
Complex normal ratio distribution A ratio distribution (also known as a quotient distribution) is a probability distribution constructed as the distribution of the ratio of random variables having two other known distributions. Given two (usually independent) random variables ''X'' ...
* Directional statistics#Distribution of the mean (polar form) *
Normal distribution In statistics, a normal distribution or Gaussian distribution is a type of continuous probability distribution for a real-valued random variable. The general form of its probability density function is : f(x) = \frac e^ The parameter \mu ...
*
Multivariate normal distribution In probability theory and statistics, the multivariate normal distribution, multivariate Gaussian distribution, or joint normal distribution is a generalization of the one-dimensional (univariate) normal distribution to higher dimensions. One d ...
(a complex normal distribution is a bivariate normal distribution) *
Generalized chi-squared distribution In probability theory and statistics, the generalized chi-squared distribution (or generalized chi-square distribution) is the distribution of a quadratic form of a multinormal variable (normal vector), or a linear combination of different no ...
*
Wishart distribution In statistics, the Wishart distribution is a generalization to multiple dimensions of the gamma distribution. It is named in honor of John Wishart, who first formulated the distribution in 1928. It is a family of probability distributions define ...
*
Complex random variable In probability theory and statistics, complex random variables are a generalization of real-valued random variables to complex numbers, i.e. the possible values a complex random variable may take are complex numbers. Complex random variables can alw ...


References


Further reading

* * * Wollschlaeger, Daniel. "ShotGroups." ''Hoyt''. RDocumentation, n.d. Web. https://www.rdocumentation.org/packages/shotGroups/versions/0.7.1/topics/Hoyt. * Gallager, Robert G (2008). "Circularly-Symmetric Gaussian Random Vectors." (n.d.): n. pag. Pre-print. Web. 9 http://www.rle.mit.edu/rgallager/documents/CircSymGauss.pdf. {{ProbDistributions, continuous-infinite Continuous distributions Multivariate continuous distributions Complex distributions